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Abstract 

The null space property (NSP) and the restricted isometry property (RIP) are 
two properties which have received considerable attention in the compressed sensing 
literature. As the name suggests, NSP is a property that depends solely on the null 
space of the measurement procedure and as such, any two matrices which have the 
same null space will have NSP if either one of them does. On the other hand, RIP 
is a property of the measurement procedure itself, and given an RIP matrix it is 
straightforward to construct another matrix with the same null space that is not RIP. 
We say a matrix is RIP-NSP if it has the same null space as an RIP matrix. We show 
that such matrices can provide robust recovery of compressible signals under Basis 
pursuit. More importantly, we constructively show that the RIP-NSP is stronger than 
NSP with the aid of this robust recovery result, which shows that RIP is fundamentally 
stronger than NSP. 


1 Introduction 

Let X G be an unknown signal that belongs to or lives close to the set S* := {w G : 
Il'M^llo := #(supp(w)) < s} in the sense that Csix) := min ||x —|/||i is small. The conventional 

ySSs 

compressed sensing problem is concerned with the task of estimating x provided that we know 
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the sensing procedure $ G and we are given the (possibly perturbed) measurement 

data y = + e with ||e ||2 < e. The challenging part is that the number of measurements 

M is far less than the ambient dimension N. In this paper, we focus on the ii minimization 
method (Basis Pursuit): 

X = argmin ||x||i subject to \\^x — y\\ 2 <e, (1.1) 

which is a well established reconstruction scheme [1]. 

A significant portion of the compressed sensing literature is devoted to the design of the 
sensing matrix $ to guarantee the success of fll.ll) . More specifically, we want the recovery 
to be stable and robust in the following way: 


X - x\\2 < Cie + C2crs{x), 


( 1 . 2 ) 


where Ci, C 2 are constants that do not grow as dimension grows. 

The restricted isometry property (RIP) and the null space property (NSP) (see dehnitions 
12. II and [2.31 respectively! are two common conditions that one imposes on <h in order to get a 
stable recovery via fll.ll) . The RIP condition with the RIP constant 52s < l/\/2 is sufficient 
to recover x (with stability and robustness as in fll.2p . see Theorem 12.4p . so in what follows, 
when we say RIP, we really mean RIP with (52s < 1/\/2. 

The two conditions have their pros and cons: 

(1) NSP is a property that only depends on the kernel of the sensing matrix <I), and RIP 
is not. 

(2) s-NSP is a sufficient and necessary condition for any a; G to be exactly recovered 
by (II.ip in the noise free case (when e = 0). 

(3) RIP provides a very stable and robust error bound as we will see in Theorem 12.41 It is 
not known that NSP guarantees such recovery. 

(4) Numerically verifying RIP and NSP are both NP-hard, but RIP is easier for theoretical 
justihcation in most cases. RIP (or RIP like conditions) also has a broader application 
to various sparse recovery algorithms. 

Note that the solution set of = y only depends on the null space of <I>, and any 
row action does not alter this set. Practically, the row operation corresponds to a mixing 
or transformation of the current data vector. If this transformation is invertible and the 
measurement is noiseless, then no new data is introduced or no old data is lost, and one 
should expect the same recovery. As such, it is natural to expect that a good reconstruction 
criteria should be able to reflect this invariant property. Moreover, it is also desirable to 
have a property that guarantees robust recovery as in (11.21) . so that the Basis Pursuit is 
not affected significantly by noisy measurements, and is able to recover compressible signals 
(signals that have small (Ts(a:)) approximately. In other words, we wish to have a property 
that combines the advantages of RIP and NSP so that: 
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(A) This property only depends on the null space of the sensing matrix. 

(B) This property guarantees stable and robust recovery similar to fll.2p . 

There have been several attempts in the literature: the width property (WP) jin|, the 
robust null space property (RNSP) jl3], and the robust width property (RWP) [3] are all 
properties on sensing matrices which guarantee the success of Basis Pursuit. However, none 
of these properties simultaneously achieve both (A) and (B). A more elaborated discussion 
about these properties can be found in Section O 

The hrst contribution of this paper is to provide a condition that only depends on the 
null space (thus achieves (A)), and also achieves (B) under certain settings. The condition 
we propose is a straightforward hybrid of RIP and NSP: 

Definition 1.1 (fc-RIP-NSP). A matrix $ has k-RIP-NSP with 5k if ^ has the same null 
space of a matrix that has PIP with 5k- 


Which provides the following guarantee for Basis Pursuit: 


Theorem 1.2. Suppose ^ is M x N and has PIP-NSP with 52s < Given x G and 

\\y — ^x \\2 < e, then the minimizer x of fll.ip satisfies 


X 


x \\2 < D 




2s 






cr.AX 


(1.3) 


where A(<h) is the smallest positive singular value of and Di, D 2 only depend on 52s o-nd 


can he found in Theorem fS.f 


Admittedly, the stability result is not as strong as fll.2p . Since the RIP-NSP condition 
has no control of the scaling nor the condition number of $, we do not expect a substan¬ 
tial improvement over (ll.3p . However, we would like to argue in certain settings this is a 
reasonable constant. In the RIP regime, say if $ is a Gaussian matrix normalized by \/M, 
the term containing Di in fll.3p becomes of order y/ M/s with high probability which is only 
worse than fll.2p by a logA^ factor for the optimal dimension M = 0(s log N). Moreover, in 
some settings N/s is a fixed constant, see for example [1]. 

Studying sensing matrices with the RIP-NSP property have potential applications in¬ 
cluding topics related to preconditioning of sensing matrices. For example, as the authors of 
m point out to us, in compressive imaging (wavelet sparse images, Fourier measurements), 
the variable-density sampling matrix has the null space of an RIP matrix but does not have 
RIP. 

People have always wondered whether the RIP condition is too strong for compressed 
sensing. In fact, one motivation for proposing RNSP and RWP is to have a weaker-than-RIP 
condition, and yet provides nice theoretical performance. Here we want to raise an even more 
basic question: Is RIP strictly stronger than NSP? With a little argument, we can see this 
question is already solved with a positive answer. The set of matrices {17<F : U is invertible} 


3 

















share the same null space, but can have dramatically different RIP constants. For example, 
suppose <F has a small ^ 2 , which means every two columns of <F are nearly orthogonal to each 
other. One can easily hnd an invertible matrix U that sends the hrst two columns of $ to 
be nearly parallel, which will result in a big constant 62 for f/d). 

In order to do a fair comparison between RIP and NSP, we need to mod out this left 
multiplication, so the right question to ask is: Given an NSP matrix d), is there an RIP matrix 
that belongs to the set {17<I> : R is invertible}? This is exactly asking whether RIP-NSP is 
strictly stronger than NSP, which gives a second purpose to this new condition. 

The second contribution of this paper is to show that RIP-NSP is strictly stronger than 
NSP. 


Theorem 1.3. Given arbitrary 7 < 1 and 62 s < -j=, if M,N,s G Z satisfy that N/2 > 

v2 ^ 

M > 2 C'( 7 / 3 )s log^ iV, A^/s > 11, and s > 0( then there exists a sensing matrix 


$ G 


t,MxN 


(1 - x/2<52.)V’ 

that satisfies {s,'y)-NSP, but does not satisfy RIP-NSP with 62 s- 


This means that the null space property is fundamentally weaker than the restricted 
isometry property as it is possible to find a subspace V that satishes the NSP, but no matrix 
with kernel V has RIP. Moreover, this theorem is surprisingly strong in the sense that no 
matter how small 7 is, NSP cannot be as good as RIP-NSP. 

Although RIP-NSP achieves (A)-(B) (when N/s is fixed), the RIP-NSP property has 
the drawback that it is not in the form of a restriction directly on the vectors in the null 
space. For future work, we wish to find an equivalent condition of RIP-NSP that is in a 
more direct form. This is also a question of whether one can construct a sensing matrix with 
restricted isometry property given that its null space is fixed and nicely structured. Theorem 
11.31 suggests that we need a property stronger than NSP. For the rest of the paper. Section 
|2] provides an overview of RIP, NSP and other related properties, and Section |3] provides 
proofs of Theorem 11.21 and Theorem 11.31 


2 RIP, NSP, and more 


N 


We will first review and dehne some notations for ease of the reading. For a vector v G 

/ N \Pp 

and p > 0, let ||n||p = j \vi\^ j . If J is an index set, P is the complement set of /, and 


\ ^=1 / 

vi G is the vector that has the same entry as v on J, but 0 everywhere else. However, 
for convenience, we also use vj to indicate the truncation of v on J, in which case vj G 
It will be clear which interpretation is used from context. 

For a matrix M, X{M) is the smallest positive singular value of M, and ||M||op is the 
operator norm of M. 
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Definition 2.1 (s-NSP). A matrix A has the null space property of order s if 


Vue ker$\{0},V |T| < s, ||ut||i < 


( 2 , 1 ) 


As summarized above, the null space property is known to be the necessary and sufficient 
condition of successful reconstruction of any s sparse signals via the Basis pursuit when no 
noise is present [T4] . 

With an argument using compactness of ker(<h) fl where is the unit sphere in 
one can prove that fl 2 .ll) is equivalent to the existence of 0 < 7 < 1 such that 


V u G ker $, V |T| < s, ||ut||i < 7||'*^t=||i- 


( 2 . 2 ) 


In fact, the null space property was also proposed in this format ng. The smallest 7 that 
makes fl2.2p holds is called the null space constant. We use (s, 7 )-NSP to denote the null 
space property of order s with null space constant 7 . We will also abuse the definition by 
saying a subspace V has (s, 7 )-NSP if ||ut||i < for every v eV and every |T| < s. 

The null space property proposed has a recovery guarantee with noisy measurements, 
but it does not have a bound like in ( 11 . 2 p . 


Theorem 2.2. 

satisfies 


Theorem Ill.f.l] If $ has {s,''y)-NSP, then any minimizer x of (II.ip 


\x — x\[i < 


A\/2\fN 4(1 + 7 ) 


(2.3) 


More results related to the stability of Iq version of null space property can be found in 
|21] . The recent work by Chen et al [9] generalizes the null space property to the dictionary 
case where a similar stability bound is also proved. 

The fundamental work on compressed sensing by Candes [ 6 ] admits a fll. 2 p type stability 
result if $ satisfies the restricted isometry property. But we will list an optimal and more 
updated result by Cai and Zhang [5j here. 


Definition 2.3 (RIP). A matrix $ has the restricted isometry property of sparsity k if there 
exists 0 < 5 < 1 such that 


(l-<5)||u||^<||«I>u||^<(l + 5)||u||2, 


for all u G Sfc. 

Moreover, the smallest 6 that satisfies the above inequality is called the restricted isometry 
constant, and denoted as (5fc(<h) or 5k when not ambiguous. 


Theorem 2.4 (Cai and Zhang [5]). If 52si^) < 


1 

71 ’ 


then the minimizer x of fll.ip satisfies 


X 


x\ 


< Die + D' 


as{x) 

* /— ? 

Vs 


(2.4) 
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where Di 


2 . 1 ], 


2'\/2(l + (52s) 
1 -\/ 2 < 52 . ’ 


and D 2 


2 


d2s + \J <52s( 1/\/2 — (52s) 


\/ 2 ( l /^/2 - 5 ; 


2s; 



see 13, Theorem 


Moreover, this RIP bound is optimal, i.e., for every e > 0, there exists $ with h 2 s(‘h) < 

+ e, and a signal x such that fl2.4p does not hold [TT] . 

The robust null space property is a stronger version of the null space property, but it is 
not a property that only depends on the kernel. A matrix $ satishes the RNSP of order s 
with constant p, r > 0 if 


1 

7 ! 


V ® 


+ r||$a;|| 2 , for all v and all |T| < s. 


It is shown in [13] that RNSP is an equivalent condition to have a stability result like fl2.4p . 
with the two constants only depend on p, r. Moreover, the author shows that RNSP is 
strictly weaker than RIP using the Weibull matrices. The work [121HH] also describe a large 
class of random matrices which satisfy an RNSP but not an RIP condition. The sparse 
approximation property in [20] is similar to RNSP. 

In a recent paper by Cahill and Mixon [3], the authors propose a robust width property, 
which requires 

Iklh < ~ 7 =lkl|i) such that ||‘hx ||2 < cilIxlU, 

Vs 

for some Cq, Ci > 0. The novelty of RWP is that it is a necessary and sufficient condition not 
only for the stability of Basis pursuit, but also for nuclear norm minimization and possibly 
other optimization problems. 


3 Proofs 

3.1 Stability result with RIP-NSP 

To prove Theorem II.2[ we show something more general, which requires a Lemma. 

Lemma 3.1. If a matrix $ has RIP with 5k, then 

||$||op < \/N/k + + 5k (3-1) 

Proof. Partition the index set {1, into {1, = UlT^Tj, where each Tj is of size k 

except for the last one T^, which has cardinality no bigger than k. Tfs are nonoverlaping. 
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so m = \N/k~\, which is the smallest integer greater than or equal to N/k. 


|<h||op = max ||*hx ||2 = max 
Ihll2=i lhl|2=i 


^TiXTi 


i=l 


< max ^ v^l + 6k\\xTi 


ii®l|2 = l . , 

2 *=1 


< Vl + 4 max 


h 2=1 


4 < ^N/k + Wl + Sk. 

\ i=i 


□ 


Proposition 3.2. Given x,x G and a list of statements 

(a) The sensing matrix A satisfies RIP with 

(b) Pill < Plli; 

(c) ^Ax - Ax \\2 < 2p; 

(d) p — a;||* < Cip + C 20 's{x), where || • ||* is some norm (or quasinorm); 

(e) The sensing matrix $ has RIP-NSP with 
(?) W^x - ^x \\2 < 2e; 

(g) p - xll* < Cl + C 2 as{x); 

If (a) + (b) + (c) ^ (d), then (e)+(b)+(f) (g). 

Before we present the proof and illustrate how to apply this proposition to get Theorem 
11.21 we wish to provide some intuitions of this seemingly odd proposition. One should view 
X and X as the original and recovered signals respectively. Then conditions (b) and (c) are 
consequences of 


x = argminp||i subject to \\Ax — y\\ 2 <p. 


(3,2) 


But practically we shall view (b) + (c) being equivalent to (13.21) because in the literature of 
stability analysis with Ii minimization, as far as we know, the proof only utilizes conditions 
(b) and (c) when model (13.2|) is used. For example, see proofs of [HI Theorem 1.2], [5l 
Theorem 2.1], etc. 

With this in mind, (a) + (b) + (c) ^ (d) is the classical statement saying that RIP guaran¬ 
tees a good stability result with Ii minimization fTheorem 12.4p . except here we allow other 
norm estimations in (d). This proposition is saying that if certain RIP conditions guarantees 
a stability result (with Ii minimization), then the RIP-NSP condition will also guarantee a 
similar stability result. Moreover, the RIP-NSP constant matches the RIP constant. 

As the main application of Proposition l3.2l we see that Theorem l2.4l states that (a)-|-(b)-|-(c) 
^ (d) (again in the proof the only information extracted from (13.21) is (b) and (c)) with p = e, 


A = $, 


1 2 , and d 2 s < and therefore we have the following corollary. 

v2 
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Corollary 3.3. Suppose ^ is M x N and has RIP-NSP with 62 s < —f- If x,x satisfies 

v 2 

ll^lli < ||a;||i and ||<l>x — $x ||2 < 2 e, then 


II. II / n VI + S2s [N as{x) 

\\x - X 2 < Di—\ —e + D2 — 1=- 
A($) Vs Vs 

Rewriting Corollary 13.31 in the language of model (II.R yields Theorem 11.21 


(3.3) 


Proof of Proposition 13.21 The assumption (e) implies that there exists an invertible matrix 
[/ such that ^ = UA and A has property RIP with 52 s- Moreover, 


\\Ax - Ax \\2 = \\U $x - U $£112 < —_||$x - $£||2 < 


2 e 

MU) 


At this point, assumptions (a) (b) and (c) are satished with p = , therefore we have 

MU) 


\x - x||* < Cl—— + C 2 crs{x). 
A[U) 


(3.4) 


AV$) = mm{UAA*U*x,x) = min {AA*U*x,U*x) < ||AA*||op min \\U*x\\^ = ||A||' A(C)T 


The rest of the proof is to estimate A(t/). Note that 
Therefore, with Lemma [3.11 

X{U) > A($)/||A|U, > 


A($) 


\/£ + ^Vi + Ms 


(3.5) 


Plug (13.5p into (13.4p . we get the desired error bound (g). □ 

Remark 3.4. The proof only uses the RIP property implicitly in terms of Lemma \3.1i 
Therefore Proposition 13.21 could he stated more generally as replacing RIP by any property 
that produces a bound like (13. ip . 


3.2 RIP-NSP is strictly stronger than NSP 

This is done by Theorem 11.21 with explicit construction. The idea is to construct a matrix 
with NSP, but does not satisfy the bound (11.31) . therefore does not satisfy RIP-NSP. This 
says that NSP is strictly weaker than RIP-NSP. 

Lemma 3.5 (Candes [6]). Assume $ G satisfies RIP of order 2s with constant 

y/26 

Ms £ (0,1). Then $ has the NSP of order s with constant 7 =- 

1 - 52s 



































Lemma 3.6 (Rudelson et al. [I9]). For any fixed absolute constant 5 < 1, when M,N,s 
satisfy M > Cfis log^ N, the random partial Fourier matrix formed by randomly choosing 
M rows from an N x N DFT matrix satisfies the RIP with constant 62 s < d with probability 

1 — 5e , where Ci, C 2 are absolute constants. 


The result in [I9] actually only directly proves the lemma for 6 = 0.5, but the same proof 
works for general 6 . Moreover, the order of M in Lemma 13.61 has been slightly improved 
recently by Bourgain [2], and subsequently by Haviv et al. [15]. The interested readers can 
thus obtain an improved version of Theorem 11.31 But we still choose to include the original 
Rudelson and Vershynin result here since this improvement is not the main point of this 
paper. 

In this paper, we work with real vector spaces due to the restriction of Theorem 12.41 so 
we need to have a lemma that can turn complex matrices to real matrices while preserving 
the restricted isometry property. 

Lemma 3.7. If F = A + Bi ^ (^mxn then so is the real matrix R = 


A 

B 


Proof. By the dehnition of RIP, we need to prove for every index set T G {1, ...,M} with 
cardinality s, it holds that 

(1-<5.)M^<||Rtx||^<(1 + <5.)|1x||2. 

for any x G M®. But this is true if we apply RIP of F on x and the fact that ||i?Ta ^||2 = 
\\Arx\\l + \\Brx\\l = \\Frx\\l. □ 

Corollary 3.8. For any given positive constant 7 < 1, there exists ^(y), such that when 
M,s,N satisfy N/2 > M > C{'j)slog^N, then there exists a matrix R G that has 

(s, 'y)-NSP and (1,..., 1)'^ G ker(i?). 


Proof. If M is even, then the partial DFT matrix F G C 2 satishes RIP 823 < 8 with 

-s'^t 

probability at least pi = 1 — 5e if M > 2C'ifs log^ iV. We further require (1,...,!)^ G 
ker(F), which is equivalent to not selecting the hrst row of the DFT matrix. Probability of 
not selecting the hrst row p 2 is at least {N — M/2)/N > 1/2. The existence of F such that 
it has RIP with 52s < 8 and (1,..., 1)^ G ker(F) is guaranteed if pi + P 2 > 1- This can be 
done if we set pi = 1/2, which requires M > C{8)s\og^ N, where C{8) = 2 log 10CiC2/5^. 


By Lemma 13.71 the matrix R 


Real(F) 

Im(F) 


G has RIP with 82 s < 8 and 


(1,...,!)^ G ker(i?). By Lemma [331 we get the desired matrix if we set 8 
which requires M > C('y)slog‘^ N, with 


7 

\/2 + 7’ 


C(7) =21oglOCiC'2 



2 
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If M is odd, we can do exactly the above with the even number M — 1. So we can get 
R' e that has (s,7)-NSP and (1,1)^ G ker(i?'). The desired R can be obtained 

by adding one row that is orthogonal to (1, • • • , 1)^ to R'. 

□ 


Proof of Theorem M.^ Step 1: Construction of d) 

The inequality M > 2C{'y/?>)s\og^ N implies (M — s) > C(7/3)s log'^(iV — s), so we can 
hnd A G that has (s,7/3)-NSP and e = (1,1)"^ G G ker A. Dehne 


and let 


Afe = {x e ker(y4) : x T e}, 
AAg = {( 0 , ..., 0 ,x) : X G Afe}, 


where d = 


N -As N -As 
-7, ——7, 


Af = Af^® span(d), 
N — As 


22 


23 


2^+1 


7, —1,—1 . In addition, if we set 


N-s 


1 


2(iV- s) 


(pi = -(a,..., a, 7,..., 7) 
P ' 


■3-^ and p be a normalization constant such that ||<pi||2 = 1, then it 


with a = - 

{N -As){l - 2 -^) 

is easy to verify that <pi T Af, and therefore there exists an orthonormal basis of Af'^ with 
(pi being one of the basis vector. Let <h be the matrix whose rows are this orthonormal basis, 
where cpi is the hrst row. 

Some quick facts about $; 

• ker <h = Af. 

• $<!)* = and therefore A(<h) = 1. 

Step 2: $ has (s, 7 )-NSP 

Since Af = Af'^, © d, we only need to prove any h = h + d satishes NSP, where h G Af'^- Let 
I = {1,..., s}, and we hrst make two observations: 


!)• Ild/lli — 


N -As 


7, 


1 - 7 < ^ = |sum(-d/c) = ^sum(-djc-h) < |||d/c + 


h||i = —lld/c + h/cjli, where sum(a;) is the sum of all coordinates of x. 
2). 6/c = hjc + d/c G ker A, so if an index set S C R, then 

ll^slli = ll(^/'=)5||i < 7/3||(^/‘=)5 =||i = 7/3||^5=n/=||i- 
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Let T G {1,iV} be any index set with cardinality s, then the above implies 

II^tIIi = ||^Tn/||i + ||^Tn/=||i < ll^/||i + II^Tn/'^lli = IMr||i + ll&Tn/'^Hi 

< 2 + ll^rn/=||i = + ||^rn/=||i 

7 7 7 2+7 

= 2 IIII ^11^^‘^nrll + ll&Tn/'^lli = H-^—ll^/'^nrlli 

7 (2 + 7 ) 7/3 

— ^ll^J'^^nr'^lli H- - -ll&r^nT^lli < 7ll^/'vir':||i < 7 ||^T':||i, 

Step 3: Recovery with <h does not satisfy (13.31) 


Let Xo = 


N-As 2 N-As 2 N-As 2 


-7 


22 ' ’ 23 ’ ■■■’ 2 ®+^ 

to recover xq from fll.ip with y = $xo — 2; and e = \\z \\2 = p- 
Notice 

X := Xq — p+i — 'yd = (—a, —a,...., —a, 0, ...0)^ 


7 ^, 0 , ...,0 and z = (p, 0,..., 0) . We wish 


is feasible in the problem fll.ip because 

11 *^’^ - 2/II2 = ll^a^o - - $xo + z\\2 = || - p<h+i + z\\2 = 0 . 

The last equality holds because the rows of $ are orthogonal and +1 is the first row of $. 
We wish to get an error bound using Corollary 13.3[ so we need to compare their £i norm. 

I'""' = 

In order to show ||x||i < ||xo||i, it suffices to show that (iV —4s)^(l — 2 “^)^ 7 ^ > 4(iV —s)s, 
which is true under the assumption that N > lls/ 7 ^ and s > 5. 

If $ were RIP-NSP with constant 62 s, then by Corollary 13.31 we would get 


\x - X 0 II 2 


/ r. +-^ ^ ^ /N{Nj^ + (a2 _ ^2)5) 

< D ,^1 + 62 s\J - D ,^1 + S 2 s^ -^- 

On the other hand, we can compute that 

11 ^ -^o ||2 = l|p+l +7C?ll2 = X] (“ + 

i=l ^ 

S 

= (a^ + 2 a 

2®+3 


(3.6) 


TV-4s 2 

2 *+i 

N-As 2 {N- Asf 


-Y + 


4«+i 


,4) > +^,4. 


(3,7) 


Under the assumption that N > lls/ 7 ^ and s > 5, we can estimate that 2 < a < 3. 
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Let the right hand side of fl3.6p be i?, so 


where C = 


11^ — xq\\\ < B? = C 
8(1 + 52 .'^ 


+ (a2 - 7^)^) 2C'72iV2 


< 


and we used the relation iV > lls /7 . 


(1 - ^/ 2 < 52.)2 

If s > 80C/7^, then we arrive at a contradiction between fl3.7p and 


(3.8) 


□ 
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